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ABSTRACT 


In  this  report,  a  mathematical  model  is  de¬ 
veloped  which  provides  criteria  for  utilizing,  in  an 
optimal  fashion,  forward  error  correction  devices 
for  retransmission  data  communication  systems. 
The  devices  are  specified  in  terms  of  delay  and 
error  correction  capability.  System  performance 
is  described  by  the  defined  terms  of  error  correc¬ 
tion  improvement  factor,  information  throughput, 
and  channel  availability. 
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SECTION  I 


INTRODUCTION 

In  digital  data  communications,  error  detection  and  retransmission  is 
one  method  of  obtaining  essentially  error-free  transfer  of  data  over  a  bursty 
channel  between  a  data  source  and  a  remotely  located  data  sink.  The  informa¬ 
tion  throughput  is  the  amount  of  error-free  information  received  by  the  data 
sink  per  unit  of  time.  In  an  error  detection  and  retransmission  system, 
throughput  decreases  as  the  rate  of  occurrence  of  errors  increases.  Forward¬ 
acting  error-correcting  codes  can  be  used  to  correct  errors  in  the  data  before 
the  data  are  examined  by  the  error  detector  of  a  retransmission  type  of  com¬ 
munication  link.  Thus,  by  decreasing  the  error  rate,  the  error-correcting 
code  can  produce  an  increase  in  information  throughput. 

Unfortunately,  use  of  forward -acting  error-correcting  codes  entails 
increased  delay  in  transmission  of  data  between  the  source  and  sink.  This 
increase  in  delay  can  produce  an  effect  which  will  decrease  the  throughput. 
Generally,  the  error  correction  capabilities  of  the  code  increase  as  the  delay 
increases.  In  this  report,  a  mathematical  model  is  developed  which  provides 
criteria  for  utilizing,  in  an  optimal  fashion,  the  forward-acting  error  cor¬ 
rection  device,  allowing  for  the  tradeoff  between  delay  and  the  error  correc¬ 
tion  capabilities  of  the  code;  and  specifying  the  performance  of  these  devices 
in  terms  of  delay  and  capabilities  of  the  code.  The  model,  which  enables 
calculation  of  the  data  communications  system  performance,  is  described  by 
the  defined  terms  of  error  correction  improvement  factor,  information 
throughput,  and  channel  availability. 

This  report  describes:  the  data  communications  system;  the  channel 
error  characteristics;  the  characteristics  of  forward-acting  error  control 
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devices;  the  mathematical  model  of  the  system  from  which  the  throughput 
is  calculated;  and  desirable  specifications  of  forward-acting  error  control 
equipment  which  permit  maximum  utilization  of  the  data  communications 
system. 

All  performance  curves  in  this  report  are  used  solely  to  illustrate  the 
method.  These  curves  are  not  derived  from  any  real  channel.  When  the 
method  described  herein  is  used  to  evaluate  a  particular  system,  the  actual 
performance  curves  describing  the  particular  channel  and  error  correction 
equipment  should  be  determined  and  used  for  calculations. 
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SECTION  II 


THE  DATA  COMMUNICATIONS  SYSTEM 

A  functional  block  diagram  of  a  typical  data  communications  system  is 
shown  in  Figure  1.  A  data  source  sends  a  sequence  of  digital  information  via 
a  noisy  channel  to  a  remotely  located  sink.  The  forward-acting  error  correc¬ 
tion  equipment  is  used  to  correct  errors  caused  by  the  channel  noise.  The 
sink  is  assumed  to  have  the  capability  to  detect  uncorrected  errors  in  the 
data  at  all  times.  This  is  a  good  assumption  since  very  powerful  error-detec¬ 
ting  codes  are  available. 


ERROR 


NOISE 


31 

a 


Figure  1  .  The  Data  Transmission  System 


The  data  are  encoded  into  information  blocks  called  words.  A  data 
word  is  considered  in  error  if  one  or  more  errors  appear  in  the  data  word. 
When  a  word  in  error  is  detected,  the  sink  may  operate  under  either  of  two 
rules  of  procedure  for  retransmission  of  the  data  in  error. 

(1)  If  an  error  is  detected,  the  sink  immediately  requests 
the  source  to  go  back  in  the  sequence  to  the  data  word 
received  in  error  and  recommence  transmission.  The 
sink  then  ignores  all  incoming  data  until  the  retrans¬ 
mitted  data  word  is  received  correctly. 

(2)  If  an  error  is  detected,  the  sink  requests  the  source 
to  retransmit  only  the  data  word  or  group  of  data 
words  containing  the  error.  The  sink  then  continues 
to  receive  all  incoming  data.  When  the  retransmitted 
word  or  group  of  words  is  correctly  received,  it  is 
inserted  into  its  proper  position  in  the  received  se¬ 
quence  of  data. 

The  first  procedure  effectively  shuts  down  data  transmission  for  an  in¬ 
terval  equal  to  the  round  trip  transmission  time,  but  requires  no  insertion  of 
retransmitted  information  into  proper  sequence  in  the  received  data.  Although 
the  second  procedure  does  not  interrupt  data  transmission,  it  requires  ad¬ 
ditional  operations  to  keep  track  of  the  sequence  position  of  each  data  word  in 
a  message. 

After  the  channel  characteristics  are  described  (Section  IH),  the  error 
correction  equipment  operation  specified  (Section  IV),  and  the  mathematical 
model  of  the  system  developed  (Section  V),  the  comparative  performance  re¬ 
sulting  from  each  of  these  rules  of  operation  will  be  calculated  (Section  VI). 
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SECTION  m 


CHARACTERISTICS  OF  THE  CHANNEL 

Error  measurements  indicates  that  communications  channels  for 
various  communication  media  are  bursty,  i.e. ,  the  error  occurrences  are 
highly  correlated.  Attempts  have  been  made  to  model  these  channels  and  to 

r  i  2 1 

list  their  relevant  statistical  characteristics  J  in  order  to  describe  the 
behavior  of  the  channel  error  patterns. 

A  quantity  commonly  used  to  describe  the  channel  is  average  word  error 

rate.  This  number  is  found  by  averaging  the  number  of  words  in  error  in  a 

fixed  interval  of  the  data  stream  over  the  total  number  of  words  in  the  interval. 

For  example,  if  10  words  were  in  error  in  an  interval  of  10  words,  the 

4  -3 

average  word  error  rate  would  be  10  divided  by  10  or  10  .  The  average 

word  error  rate  varies  from  interval  to  interval.  The  quantity  is  usually 
plotted  as  in  Figure  2,  which  shows  the  percent  of  time  the  channel  average 
word  error  rate  is  less  than  a  value  specified  on  the  abscissa.  This  per¬ 
cent  of  time  is  defined  as  the  channel  availability. 

For  a  channel  with  random,  uncorrelated  error  patterns,  average  word 
error  rate  is  a  good  measure  of  transmission  quality.  For  bursty  channels, 
however,  average  word  error  rate  is  not  a  very  meaningful  measure  unless 
additional  higher  order  probabilities  describing  the  channel  behavior  are 
given.  In  this  report,  however,  only  average  word  error  rate  is  used  to 
iUustrate  the  method.  Higher  order  probability  terms  would  vary  the  calcu¬ 
lated  results,  but  not  the  method. 
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Figure  2.  Unimproved  Channel  Availability,  A 


-6- 


SECTION  IV 


CHARACTERISTICS  OF  FORWARD- AC  TING  ERROR 
CORRECTION  EQUIPMENT 

Forward-acting  error  correction  is  used  to  decrease  the  average  word 
error  rate,  P  ,  of  the  unimproved  channel  to  a  new  value,  P  .  The  factor  of 

G  C 

improvement,  F,  is  given  by, 


P 


c 


A  typical  characteristic  of  the  commonly  used  codes  is  that  the  im¬ 
provement  factor  increases  monotonically  as  P^  decreases.  Hence,  as  the 
channel  average  word  error  rate  decreases,  i.e. ,  the  channel  quality  im¬ 
proves,  error  correction  provides  greater  improvement.  An  illustrative 
curve  of  F  versus  P  ^  is  shown  in  Figure  3.  Equation  (1)  expresses  P 
as  a  function  of  F  and  P  Figure  2  shows  the  percent  of  time  that  the 
channel  error  rate  before  error  correction,  P  ,  is  less  than  a  given  value. 
Using  Figure  3  and  Equation  (1),  a  curve  may  be  derived  from  Figure  2  to 

show  the  percent  of  time  that  the  word  error  rate  of  the  improved  channel,  P  , 

c 

is  less  than  a  given  value.  This  curve  is  shown  in  Figure  4. 

The  error  rate  improvement  always  entails  increased  transmission 
delay  because  of  encoding  and  decoding  calculations  or  operations  of  the 
equipment  which  attempt  to  match  the  characteristics  of  the  code  to  the  chan¬ 
nel.  In  general,  the  greater  the  allowable  delay,  the  more  arithmetic  opera¬ 
tions  are  possible,  the  more  closely  the  code  can  be  matched  to  the  channel, 
and  the  greater  the  achievable  improvement  factor.  Figure  3  illustrates  the 
behavior  of  F  versus  P^  for  two  different  delays.  The  delay,  D,  shown  in 
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Figure  3.  Improvement  Factor,  F,  Versus  Unimproved 
Channel  Average  Word  Error  Rate,  Pg 
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AVERAGE  WORD  ERROR  RATE,  Pe  OR  Pc 


ro 

CD 


Figure  4.  Availability  of  Improved  Channel,  A 
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the  figure  includes  the  channel  propagation  delay  and  the  delay  due  to  error 

correction.  The  one-way  delay  is  D/2,  and  the  round  trip  delay  is  D. 

The  coding  equipment  determines  the  improvement  factor,  F,  and  delay, 

D.  These,  in  turn,  can  be  related  to  the  channel  word  error  rate  ,  P  ,  in 

e 

order  to  calculate  throughput  and  availability  of  the  data  transmission  system 
described  in  Section  n. 
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SECTION  V 


THE  MATHEMATICAL  MODEL 


INTRODUCTION 

In  tins  section,  expressions  are  derived  for:  the  average  length  of  an 
error-free  sequence  of  data  words;  the  throughput  rates  for  the  two  types  of 
retransmission  schemes;  and  the  availability  of  the  channel  for  the  two  re¬ 
transmission  schemes.  All  calculations  assume  that  channel  errors  occur 
randomly  and  independently.  Actually,  with  and  without  error  correction, 
the  channel  is  bursty,  and  the  results  for  real  channels  should  be  modified 
accordingly.  In  order  to  describe  the  method  and  its  use,  however,  the  com¬ 
plications  arising  from  the  assumption  of  a  bursty  channel  are  omitted. 

AVERAGE  LENGTH  OF  AN  ERROR-FREE  SEQUENCE 

Let  P  be  the  probability  that  a  word  is  received  by  the  sink  with  an 
error.  Let  P  equal  1-P.  From  the  theory  of  combinatorial  analysis,  it 
can  be  shown  that  the  probability  of  a  sequence  of  n  words  being  transmitted 
without  any  errors,  L(n),  is  given  by 


L(n)  =  P  P° ,  n  >  1 


(2) 


and 


L(l)  =  1,  n  =  1. 


The  average  sequence  length,  n,  is  given  by 


oo 


n  =  Y,  n  L  (n)  . 
n=0 

Substituting  Equation  (2)  into  Equation  (3)  gives 


(3) 


00 


n  =  1  +  ^3  n  P  PU  . 


(4) 


n=0 
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Equation  (4)  reduces  to 


(5) 


n  =  1  + 


P  P 


2 


(1  -  P) 


Therefore,  the  average  length  of  the  errorless  sequence  is  P/P  words. 

THROUGHPUT  OF  THE  INTERRUPTED  TRANSMISSION 

A  retransmission  caused  by  the  occurrence  of  an  error  and  the  termin¬ 
ation  of  a  sequence  of  errorless  words  results  in  a  transmission  interruption 
interval  of  D  words,  which  includes  the  word  which  is  retransmitted  by 
request.  The  average  time  of  transmission  without  interruption  is  fi  words. 
The  average  transmission  interval  without  interruption  is  n,  and  the  average 
interruption  duration  is  (x  +  1)  D,  where  (1  +  x)  is  the  average  number  of 
transmissions  needed  to  receive  without  error  the  requested  word.  The 
throughput,  Tj,  is  defined  as  the  ratio  of  n  to  the  sum  of  n  plus  (x  +  1)D. 
The  average  number  of  retransmissions  needed  to  receive  without  error  the 
word  which  was  in  error  after  the  first  transmission  is  x.  Thus, 


n 


T 


(6) 


I 


n  +  (1  +  x)  D 


The  average  interruption  duration  is  D  times  the  average  number  of 


times  (x  +  1)  that  a  word  received  in  error  must  be  transmitted  in  order  to  be 


received  without  errors.  From  the  mathematics  of  combinatorial  analysis,  it 
can  be  shown  that  the  probability  of  x  transmissions  before  an  error-free 
retransmission,  K(x),  is  given  by 


K  (x)  =  P  P 


x 


(7) 
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The  average  number  of  transmissions  before  an  error-free  retransmission  is 
given  by 

00 

X  =  £  x  K(x)  .  (8) 

x=0 

Substituting  Equation  (7)  into  Equation  (8)  yields 

00 

X  =  P  £  xPX  •  (9) 

x=0 

Equation  (9),  which  is  similar  to  Equation  (4),  reduces  to 

x  =  .  (10) 

Therefore,  the  average  number  of  retransmissions  including  the  error-free 
retransmission  is  1  +  x ,  or,  since  P  plus  P  equals  unity,  l/P.  The 
average  retransmission  shutdown  time  including  an  error-free  repeat  of  the 
word  originally  in  error  is  D/P  word  intervals. 

Substituting  Equations  (10)  and  (5)  into  Equation  (6)  yields 


T  =  - 1/P  . 

1  1/P  +  D/P 

for  the  throughput.  Equation  (10)  may  be  rewritten  as 


T 

I 


P 

P  +  DP 


(11) 


(12) 
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THROUGHPUT  OF  THE  CONTINUOUS  TRANSMISSION 


In  a  continuous  transmission  system,  errors  do  not  cause  transmission 
interruptions.  If  a  word  or  group  of  words  is  received  by  the  sink  with  errors, 
this  block  of  data  is  retransmitted  out  of  sequence  and,  if  received  correctly, 
reinserted  in  proper  sequence  at  the  sink.  Hence,  each  word  or  group  of 
words  carries  identification  information  so  it  may  be  retransmitted  out  of 
sequence  and  inserted  into  correct  sequence  position  at  the  data  sink.  The 
retransmission  shutdown  interval,  D,  is  one  word  or  one  group  of  words. 

Thus,  from  Equation  (12)  where  D  equals  1,  the  throughput  becomes 


P 


T  =  (1  -  R) 
c 


(13) 


P  +  P 


where  R  is  the  fraction  of  information  units  per  word  or  group  of  words 
devoted  to  identification.  Thus,  the  transmission  delay  does  not  affect 
throughput,  but  it  does  determine  how  many  words  separate  the  retransmitted 
word  from  its  proper  place  in  the  sequence. 

In  order  to  reduce  the  fraction  of  information  devoted  to  identification, 
R,  the  data  may  be  transmitted  and  examined  for  errors  N  words  at  a  time. 
When  data  are  transmitted  in  groups  of  N  words,  all  N  words  must  be 
received  without  errors  or  a  retransmission  is  requested.  The  probability  of 
successful  transmission  P(N)  is  given  by 


-  N 

P  (N)  =  P 


(14) 
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The  probability  that  the  N  word  block  contains  at  least  one  error  P(N)  is 
given  by 

P(N)  =  1  -  P  N  .  (15) 

Let  n^  be  the  average  number  of  blocks  transmitted  without  any  errors  and 
1  +  be  the  average  number  of  transmissions  of  N  word  blocks  in  order  to 
receive  correctly  a  block  which  w'as  in  error  after  the  first  transmission. 
From  combinatorial  analysis  similar  to  that  of  Section  V, 


and 


n  =  P-M 
N  P  (N) 

x  =  P-(N) 

XN 

P  (N) 


(16) 


(17) 


The  throughput,  T  (N),  of  the  continuous  transmission  when  data  are  trans- 
c 

mitted  in  N  word  blocks  is  given  by 


T  (N) 
c 


n. 


N 


+  (XN  +  1) 


(18) 


Using  Equations  (14),  (15),  (16),  and  (17),  the  throughput  becomes 


COMPARATIVE  THROUGHPUTS  OF  THE  OPERATION 


The  throughput  for  the  interrupted  transmission  case  described  in 

Section  V  is  given  in  Equation  (12)  as  a  function  of  P  and  D.  The  through- 

put  for  the  continuous  transmission  case  described  in  Section  V  is  given  in 

Equation  (19)  as  a  function  of  P  and  N.  Figure  5  graphically  illustrates 

c 

throughput  versus  channel  average  word  error  rate  for  D  equal  to  10^  and 
102  words  and  N  equal  to  16  and  64  words. 

For  these  particular  examples,  the  curves  show  that,  as  the  channel 
word  error  rate  decreases,  the  throughput  of  the  continuous  transmission 

case  has  a  much  faster  rise  to  its  maximum  than  the  interrupted  transmission 
case.  Also,  while  the  shorter  block  requires  a  high  percentage  of  identifica¬ 
tion  information,  the  throughput  is  higher  for  error  rates  below  10-2. 

The  effect  of  transmission  delay  in  reducing  the  throughput  of  the  in¬ 
terrupted  transmission  case  is  also  shown  in  Figure  5.  Thus,  to  increase 
the  throughput  of  this  type  of  operation,  the  delay  should  be  as  short  as 
possible  to  attain  a  given  channel  error  rate  improvement  factor.  The 
optimal  tradeoff  between  delay  and  improvement  factor  is  found  in  the 
Appendix.  The  results  show  that,  for  the  interrupted  transmission  case, 
optimal  throughput  is  obtained  when  the  improvement  factor  increase  is 
directly  proportional  to  the  increase  in  delay. 
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Tc  (N)=  THROUGHPUT  OF  CONTINUOUS 
TRANSMISSION  USING  N  WORD 
BLOCKS  - * 

Tj  =  THROUGHPUT  OF  INTERRUPTED 
TRANSMISSION - 

D  *  ROUND  TRIP  TRANSMISSION 
DELAY 


AVERAGE  WORD  ERROR  RATE)PC 


? 


Figure  5. 


Throughput,  T,  Versus  Average  Word  Error  Rate, 


P 

c 
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SECTION  VI 


AVAILABILITY  OF  THROUGHPUT 


Figure  2  shows  the  percent  of  time  that  the  unimproved  channel  average 
word  error  rate,  Pe,  is  less  than  a  given  value.  This  quantity  is  defined  as 

the  channel  availability,  A,  for  a  given  level  of  error  rate,  P  .  Figure  4 

e 

shows  the  availability  of  the  improved  channel.  Figure  5  plotted  throughput, 
T,  as  a  function  of  channel  word  error  rate.  Using  Figures  4  and  5,  it  is 
possible  to  plot  the  channel  availability,  A^,,  for  a  given  level  of  throughput, 
T.  These  curves  are  shown  in  Figure  6. 

Thus,  the  availability  of  throughput  of  the  channel,  A^,  is  the  percent 
of  time  the  information  throughput  is  greater  than  a  given  value  T.  This 
measure  of  performance  enables  the  system  designer  to  calculate  how  often 
a  given  level  of  throughput  performance  will  be  obtained. 

Examination  of  Figure  6  reveals  that  the  continuous  transmission  case 
has  a  sharp  threshold  in  throughput  availability  as  well  as  throughput.  The 
64-word  block  continuous  transmission  operation  is  generally  worse  than  the 
16-word  block,  but  it  crosses  over  to  a  higher  throughput  depending  upon  the 
improvement  factor. 

An  additional  curve  (also  plotted  in  Figure  6),  which  provides  some 
useful  information,  is  the  plot  of  throughput  availability  of  the  interrupted 

9 

transmission  for  D  equal  to  10  words.  This  curve  uses  the  unimproved 
channel  availability  curve  of  Figure  2.  For  this  case,  it  is  interesting  to 
note  that  for  the  unimproved  channel  the  throughput  availability  is  generally 
better  than  for  the  improved  channel  if  the  delay  is  too  large  (e.g. ,  10^)  for 
the  extra  improvement  in  channel  error  rate  availability.  This  illustrates 
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Figure  6.  Availability  of  Throughputs, 
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again  the  tradeoff  between  delay  and  improvement  factor  for  the  interrupted 
transmission  case  previously  discussed.  Delay  does  not  affect  throughput 
of  the  continuous  transmission  case,  however,  and  there  is  no  tradeoff  possible 
for  maximizing  throughput. 
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SECTION  VII 


CONCLUSIONS 


A  method  of  evaluating  the  performance  of  communication  systems 
using  retransmission  error  control  is  to  calculate  throughput  availability. 

Two  different  systems  are  compared  taking  into  account  error  rate,  message 
overhead,  and  transmission  delay.  Delay  has  no  effect  on  the  continuous 
transmission  system,  but  the  necessity  for  block  identification  can  decrease 
the  maximum  obtainable  throughput.  For  the  interrupted  transmission  system, 
extra  transmission  delay  to  obtain  a  decrease  in  error  rate  may  not  increase 
throughput  availability  if  certain  derived  limits  are  exceeded. 
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APPENDIX 


THE  TRADEOFF  RULE  BETWEEN  Pc  AND  D  FOR 
THE  INTERRUPTED  TRANSMISSION  CASE 


Error  correction  is  used  to  decrease  the  channel  average  word  error 
rate,  P  .  The  reduction  in  P  always  entails  delay:  the  greater  the  allow- 
able  delay,  the  greater  the  achievable  reduction  in  Pc„  By  inspecting  Equa¬ 
tion  (12),  it  is  obvious  that  the  throughput  will  increase  if  an  increase  in  delay 
results  in  a  proportionally  greater  decrease  in  error  probability. 

The  effect  is  graphically  illustrated  in  Figure  7.  Let  the  optimal  oper¬ 
ating  point  (P* ,  D*)  be  that  point  that  results  in  a  maximum  throughput,  t!, 
which  is  that  point  where 


dT 


* 

I 


dD 


To  simplify  the  calculation,  assume 
unity.  Thus, 


0  . 


(20) 

is  very  small  so  that  Pc  approaches 


P 


c 


(21) 


Equation  (12)  thus  becomes 


Taking  the  derivative  of 
the  expression 


TI  = 


1  +  P  D 
c 


(22) 


T  with  respect  to  D  from  Equation  (22)  results  in 


dP 


dT 


I  = 


-P  -D 
c 


dD 


dD 


(1  +  Pc  D) 


(23) 
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Figure  7.  Probability  of  Word  Error,  P,  Versus  Delay,  D 
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From  Equation  (22), 


dP 


-P*  -D* 


dD 


-  0 


*  *  2 
(1  +P*  D  ) 


(24) 


Equation  (24)  reduces  to 


(25) 


For  any  channel  for  which  a  P  versus  D  curve  can  be  determined, 
the  optimal  operating  point  is  at  those  points  which  satisfy  Equation  (25). 
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